Overview and Summary of the Second AIAA High Lift 
Prediction Workshop (Invited) 


The second AIAA CFD High-Lift Prediction Workshop was held in San Diego, California, in June 2013. 
The goals of the workshop continued in the tradition of the first high-lift workshop: to assess the numer- 
ical prediction capability of current-generation computational fluid dynamics (CFD) technology for swept, 
medium/high-aspect-ratio wings in landing/takeoff (high-lift) configurations. This workshop analyzed the flow 
over the DLR-F11 model in landing configuration at two different Reynolds numbers. Twenty-six participants 
submitted a total of 48 data sets of CFD results. A variety of grid systems (both structured and unstructured) 
were used. Trends due to grid density and Reynolds number were analyzed, and effects of support brackets 
were also included. This paper analyzes the combined results from all workshop participants. Comparisons 
with experimental data are made. A statistical summary of the CFD results is also included. 
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I. Introduction 


The prediction of high-lift aerodynamic flows is a challenging but important aspect in the analysis of aircraft 
configurations. Today’s computational fluid dynamics (CFD) codes have proven to be reliable and consistent for 
simplified, cruise-type configurations, but the complexities inherent in high-lift configurations add a significant degree 
of uncertainty. The complexities in high-lift flows include wakes in pressure gradients, wake/boundary-layer merging, 
streamline curvature, separated flow, possible unsteady flow, wing-tip vortical flow, and laminar/turbulent transition 
regions on each wing element (slat, main wing, flap). 1 2 

To advance the state of the art in predicting high-lift flows, an open international workshop series was estab- 
lished with the following long-term objectives: (1) assess the numerical prediction capability (mesh, numerics, tur- 
bulence modeling, high-performance computing requirements, etc.) of current-generation CFD technology for swept, 
medium/high-aspect ratio wings in landing/take-off (high lift) configurations, (2) develop practical modeling guide- 
lines for CFD prediction of high lift flow fields, (3) advance the understanding of high lift flow physics to enable 
development of more accurate prediction methods and tools, (4) enhance CFD prediction capability for practical high 
lift aerodynamic design and optimization, (5) provide an impartial forum for evaluating the effectiveness of existing 
computer codes and modeling techniques, and (6) identify areas needing additional research and development. 

Previously, the first high lift prediction workshop (HiLiftPW-1) was held in June 2010 in Chicago, Illinois. The 
workshop focused on the three-element NASA Trapezoidal Wing configuration 2, 3 at Re c = 4.3 x 10 6 ; the workshop 
overview can be found in Slotnick et al., 4 and the summary is given in Rumsey et al. 5 The overall conclusions were 
as follows. CFD tended to under-predict lift, drag, and the magnitude of the pitching moment (pitching moment 
was negative) compared with experiment, and there was significantly more spread among the CFD solutions near 
stall. Despite the general under-prediction in lift, many participants were able to predict Cl, max and the angle of 
attack at which it occurred reasonably well. The trends with grid refinement were generally in the correct direction 
(approaching experiment), but it was difficult to draw firm conclusions because CFD grid convergence studies were 
only done without support brackets. Including support brackets resulted in lower predicted lift. Transition modeling, 
included by only a few participants, appeared to be very important for this configuration, tending to increase predicted 
lift. An unstructured tetrahedral grid solution was found to exhibit greater grid sensitivity than the solution on the 
same grid with its boundary-layer tetrahedra merged into prisms. The flow field near the wing tip was very difficult 
to predict. Nearly all entries seriously under-predicted the suction near the wing-tip upper surface, and neglecting 
viscous cross-derivative terms yielded even worse predictions near the wing tip than full Navier- Stokes. Statistically, 
the deltas predicted by CFD between two different configurations were somewhat low at a = 13°, and significantly 
high at a = 28°. Subsequently, many of the HiLiftPW-1 participants wrote papers highlighting their workshop 
results, 6-19 and additional papers were produced for a later special session focused on the NASA Trapezoidal Wing at 
an AIAA meeting in June 2012 in New Orleans, Louisiana. 20-32 

The second high lift prediction workshop (HiLiftPW-2) was held in June 2013 in San Diego, California. a The 
configuration selected for analysis was the DLR-F11 three-element wing-body model. 33 This configuration was pre- 
viously used in the EUROLIFT research program. 34 The DLR-F11 was of interest because it was more representative 
of a realistic aircraft configuration than the NASA Trapezoidal Wing. Also, because the DLR-F11 was tested at both 
low and high Reynolds numbers, a major focus of HiLiftPW-2 was the ability of CFD to capture the Reynolds number 
effects. 

This paper summarizes the HiLiftPW-2 workshop data, including several corrections and additional submissions 
by some participants soon after the workshop. A total of 26 groups submitted 48 entries. (This was slightly more than 
HiLiftPW-1, which had 21 groups and 39 entries.) In addition to describing the overall collective results in comparison 
to experimental data, an attempt is made in this paper to identify trends as well as outliers. In the interest of brevity, 
only representative results are shown in some cases. 

The paper is organized as follows. First, the geometry and experimental data are briefly described, followed by a 
summary of the test cases and grid systems. A summary of the entries is then given. The results section includes a 
turbulence model verification test that was an optional exercise for the workshop participants, intended to help identify 
possible turbulence model implementation issues. Then, for the DLR-F11, the main results include force, pitching 
moment, grid convergence, iterative convergence, velocity, and surface pressure and skin friction coefficients. A 
statistical analysis is conducted in which scatter limits are calculated. As part of this statistical analysis, the ability to 
predict the differences between low and high Reynolds numbers is looked at in greater detail. Finally, conclusions are 
drawn. 

a http://hiliftpw.larc.nasa.gov, accessed 11/13/2013. 
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II. Geometry and Experimental Data 


The DLR-F1 1 model — a generic semi-span, three element high lift wing configuration with a body pod — is shown 
in Fig. 1. It is intended to be representative of a commercial wide-body twin-jet high lift configuration, but the 
workshop focused on a simplified full-span flap geometry. The untwisted swept wing had a semi-span (B / 2) of 1.4 m 
and an aspect ratio (AR) of 9.353. The mean aerodynamic chord (c) was 0.34709 m. The high lift system consisted of 
a leading edge slat and a trailing edge Fowler flap, both full- span for the cases considered in this workshop. Transition 
was fixed on the body pod, but not on any of the wing elements. The slat was attached to the main wing using seven 
slat tracks. The flaps were mounted with five flap tracks and a fixing of the inner flap edge at the fuselage. The flap 
tracks were covered by flap track fairings. The high lift devices directly intersected with the fuselage. Due to the 
small size of the slat tracks, it was necessary to attach pressure tube bundles along the outside of the tracks for their 
routing into the slat element. Additional geometry and instrumentation details can be found in Rudnik et al. 33 Note 
that throughout this paper, the slat tracks and flap track fairings are often collectively referred to as “support brackets” 
or “brackets.” 

The model was tested both at low Reynolds numbers in the low-speed wind tunnel Airbus-Deutschland (B-LSWT), 
as well as at high Reynolds numbers in the European Transonic Windtunnel (ETW). The wing was equipped with 
487 pressure taps in ten chordwise pressure sections. In addition to forces, moments, and surface pressures, the 
low Reynolds number test included flow field velocity measurements using particle image velocimetry (PIV) and oil 
flow visualization. Other measurements not directly considered here included hot film, infared, and tuft videos. At 
Re c = 1.35 x 10 6 , Cl, max occurred near a = 19°. Oil flow visualization at low Reynolds number suggested that 
at stall there were large isolated areas of separated flow over the main wing behind two of the slat tracks, spreading 
out laterally towards the trailing edge. In stall, the largest area of separated flow over the main wing was near mid- 
span. Close to the flap trailing edge, separation trends were visible even at low angles of attack. The high Reynolds 
number test included forces, moments, and surface pressures. Tuft videos were made, but are not considered here. At 
Re c = 15.1 x 10 6 , Cl, max occurred near a = 20 — 21°. Additional details about the experimental data, including 
short- and medium-term repeatability as well as facility effects, can be found in Rudnik et al. 33 

III. Test Cases 

Like in HiLiftPW-1, the workshop test cases for HiLiftPW-2 were designed to generate enough quality CFD data 
so that meaningful solver- to-solver comparisons, as well as CFD comparisons with test data, could be conducted. The 
amount of data generated was extensive, including forces and moments, surface pressures and skin friction, velocity 
profiles, and both grid convergence and iterative convergence data. All DLR-F11 cases were in one particular landing 
configuration (slat 26.5°, flap 32°). The geometry was approximated in a series of configurations that built up the 
model for improved geometric fidelity: 

• Config 2 - wing/body /high lift system plus side-of-body flap seal; 

• Config 4 - same as Config 2 plus slat and flap support brackets; 

• Config 5 - same as Config 4 plus slat pressure tube bundles 

There were four test cases defined for the workshop. Three of these involved DLR-F11 Config 2, 4, or 5. The 
fourth test case was a simple verification exercise intended to isolate potential inconsistencies in turbulence model 
implementations. For the DLR-F11, the participants were asked to run on at least one of the grid series (detailed 
in the next section) supplied by the HiLiftPW committee. They were also allowed to create their own grids. In all 
cases, no wind tunnel walls or model support systems were to be included. The high Reynolds number conditions 
(corresponding to ETW) were Re c = 15.1 x 10 6 , M = 0.175, T re f = 114.0 K, p re f = 295 kPa. The low Reynolds 
number conditions (corresponding to B-LSWT) were Re c = 1.35 x 10 6 , M = 0.175, T re f = 298.6 K, p re f = 100.7 
kPa. The four test cases for the workshop are summarized here: 

CASE 1 (required): Grid Convergence Study on Config 2 at high Reynolds number conditions 

• a = 7°, 16°, (optional 18.5°); 

• Coarse, Medium, and Fine grid solutions are required (Extra-Fine optional); 

• run fully turbulent 

CASE 2: Reynolds Number Study on Config 4, using Medium grid density 

• Case 2a (required) - low Reynolds number conditions; 

• a = 0°, 7°, 12°, 16°, 18.5°, 19°, 20°, 21°; 

• run fully turbulent 
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• Case 2b (required) - high Reynolds number conditions; 

• a = 0°, 7°, 12°, 16°, 18.5°, 20°, 21°, 22.4°; 

• run fully turbulent 

• Case 2c (optional) - low Reynolds number conditions; 

• a = 0°, 7°, 12°, 16°, 18.5°, 19°, 20°, 21°; 

• run with specified transition and/or transition prediction methods 

CASE 3: Full Configuration Study on Config 5, using Medium grid density 

• Case 3a (optional) - low Reynolds number conditions; 

• a = 0°, 7°, 12°, 16°, 18.5°, 19°, 20°, 21°; 

• run fully turbulent and/or run with transition 

• Case 3b (optional) - high Reynolds number conditions; 

• a = 0°, 7°, 12°, 16°, 18.5°, 20°, 21°, 22.4°; 

• run fully turbulent and/or run with transition 

CASE 4 (optional): Turbulence Model Verification Study 

• 2-D bump case from http://turbmodels.larc.nasa.gov; 

• M = 0.2, Re = 3 million per unit length; 

• grid convergence study (at least 3 finest grid levels) 

IV. Grid Systems 

For Case 1, five different DLR-F11 grid systems were supplied by the HiLiftPW committee, as summarized in 
Table 1 and Fig. 2. Grids for Case 2 were provided at the medium level for B, C, D, and E, and grids for Case 3 
were provided at the medium level for B and D, with E added several months after the workshop. The committee 
requested that all grids be developed according to a best-practice guideline published to the workshop website (noted 
in an earlier footnote). For brevity, only a few of the guidelines are summarized here; details can be found on the 
workshop website. 

Each Case 1 grid system family was expected to supply at least three grids differing by levels of global refinement. 
At a minimum, coarse, medium, and fine grids were required with a nominal growth rate of 3 in total number of grid 
points or cells between one level and the next finest level. The far field was to be located at a distance of approximately 
100 reference chords (i.e., 100c) for all grid levels. 

The C and D grids were both constructed with tetrahedral elements; these were also subsequently merged to create 
mixed element grids with prism elements in the boundary layers. As described later, all participants who made use 
of these grids employed the mixed versions. Note that the block structured grid system A was also translated into 
unstructured hexahedral grids. 


V. Summary of Entries 

A summary of the entries to the HiLiftPW-2 is given in Tables 2 and 3. It includes an identifier for each submission, 
the code used, the code type (structured or unstructured), the grid system, the turbulence model, and other relevant 
information. All submissions were assigned an entry number, which consists of a primary number in front of the 
decimal point that identifies the group or person submitting the data, and a secondary sequence after the decimal point 
that identifies variations (for example, different grids, codes, or turbulence models). There were 26 individuals/groups 
who submitted 48 entries. The primary numbers are not sequential because there were three groups who dropped out 
prior to the workshop. Note that the structured codes that used grid system A employed point-match blocking, whereas 
those that used grid system E employed overset. 

For turbulence models, most participants used the Spalart-Allmaras (SA) model 35 or variant. Five of the variants 
are rotation/curvature (RC), 36 rotation (R), 37 Edwards, 38 SALSA, 39 and quadratic constitutive relation (QCR). 40 The 
so-called “noft2” variant simply ignores the f t 2 term in the turbulence model equation, which is believed to make very 
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Table 1. Summary of supplied grids for Case 1 (number of grid points/cells given in millions) 


Label 

Grid 

Responsible 

Type 

Coarse 

Medium 

Fine 

Extra-Fine 

Notes 


Tool 

Org 


pts / cells 

pts / cells 

pts / cells 

pts / cells 


A 

ICEM CFD 

Boeing 

str 

11/10 

34/32 

105/101 

n/a 

point-matched, 
no brackets 




unstr 

10/10 

32/32 

101/101 

n/a 

hexahedra 

B 

SOLAR 

DLR 

unstr 

9/21 

26/59 

73 / 165 

n/a 

mixed 

C 

Pointwise 

Pointwise 

unstr 

20/44 

59/133 

177/417 

n/a 

mixed 





20/117 

59 / 349 

177/ 1053 

n/a 

tetrahedra 

D 

VGRID 

UWyo & 

unstr 

10/29 

31/99 

76 / 274 

n/a 

mixed 



Cessna 


10/60 

31/181 

76 / 447 

n/a 

tetrahedra 

E 

misc. 

Boeing 

str 

29/28 

69/67 

231/226 

545 / 537 

overset 


little difference.* 3 Other models utilized by participants were SST, 41 SST-V, 42 K-e-Rt 43 EARSM, 44 and Wilcoxl988 45 
There were also several non-traditional (not Reynolds-averaged Navier- Stokes) methods. The UNICORN code, a gen- 
eral Galerkin adaptive finite element method, used an implicit subgrid scale (SGS) model by numerical stabilization. 
The PowerFLOW code, a lattice-Boltzmann (LB) method, used a proprietary very large eddy simulation (VLES) wall 
model. The XFlow lattice-Boltzmann code used a proprietary wall-modeled local-eddy simulation (WMLES) model. 
For transition, an amplification factor transport (AFT) model, 46 the SST-GRET model, 47 and a proprietary transition 
method (in PowerFLOW) were used. 


VI. Results 


A. Turbulence Modeling Verification 

An optional verification exercise (Case 4) was included in HiLiftPW-2 in part because a similar exercise had previously 
proved to be very useful for identifying discrepancies in turbulence modeling implementations at the fifth drag predic- 
tion workshop (DPW-5). 48 Here, a simple 2-D bump case was used. At the website http://turbmodels.larc.nasa.gov, 
several different independent CFD codes (some of which have been previously verified) using the SA, SST, SST-V, 
and Wilcox2006 models have been shown to produce nearly identical results for this case as the grid is refined. Thus, 
the website has established high confidence in a grid-converged result for each of these models for this case. Any 
other code should expect to approach the same answer as the grid is refined, when using the same turbulence model 
and boundary conditions. A different solution indicates either an incorrect implementation of the model, an incor- 
rect procedure or boundary condition, or a bug in the code. For example, in DPW-5, it was learned that inaccurate 
computation of the minimum distance function could lead to significant errors in SA results. 

There were ten Case 4 submissions in HiLiftPW-2. Eight of these were for the SA model (or variant). Figure 3 
shows the SA and SA variant results. In Fig. 3(a), the Cf over a portion of the bump is shown. Three of the results 
were indistinguishable: 002.1, 002.2, and 013.1. (Note that 002.1 and 002.2 corresponded to results already posted on 
the website http://turbmodels.larc.nasa.gov.) Of the other results, 007.1, 007.2, and 011.1 were slightly different, and 
the model variants 01 1.2 (SA-Edwards) and 011.3 (SA-salsa) were significantly different. 

Comparing like-models only (SA) in the grid convergence study of Fig. 3(b), one can see that indeed 002.1, 002.2, 
and 013.1 were all approaching the same Cf at location x = 0.6322 as the grid was refined ( h 2 — » 0). Submission 
007.1 was only slightly low, but 007.2 was 2% low and 01 1.1 was about 3% high in this particular metric. Comparing 
Cf at other locations yielded similar results. This study indicates that there are potential problems or inconsistencies 
in the implementation of the SA model in 007.2 and 011.1 that should be investigated. 

The other two Case 4 submissions were 010.1 (K-e-Rt) and 018 (SST). The former currently has no other code to 
compare against for Case 4, and the latter used a different turbulence model for its Cases 1 and 4. Therefore, these 
results are not shown here. 

b See http://turbmodels.larc.nasa.gov, accessed 11/13/2013. 
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Table 2. Summary of entries 


Entry 

Number 

Code 

Name 

Type 

Grid 

System 

Turb 

Model 

Cases run 

ITER 

provided? 

002.1 

FUN3D 

unstr 

D(mixed) 

SA 

Cl, C2a, C2b, C4 

Y 

002.2 

CFL3D 

str 

A 

SA 

Cl, 04 

Y 

003.1+ 

OVERFLOW 

str 

E 

SA, SA+AFT 

Cl, C2a, C2b, C2c(trans) 

N 

003.2 

OVERFLOW 

str 

E 

SA-RC 

Cl, C2a, C2b 

N 

003.3+ 

OVERFLOW 

str 

E 

SA-QCR+AFT 

C2c(trans) only 

n/a 

004.1 

CFD++ 

unstr 

B + nc 

SA-RC 

Cl only 

Y 

004.2* 

CFD++ 

unstr 

C + nc 

SA-RC 

C2b only 

n/a 

005.1 

HiFUN 

unstr 

A 

SA 

Cl only 

Y 

005.2+ 

HiFUN 

unstr 

B 

SA 

Cl, C2a, C2b 

Y 

006 

FUN3D 

unstr 

D(mixed) 

SA-RC 

Cl only 

Y 

007.1+ 

CFLOW 

unstr 

C (mixed) 

SA 

Cl, C2a, C2b, C4 

Y 

007.2+ 

UG3 

unstr 

C (mixed) 

SA 

Cl, C2a, C2b, C4 

Y 

007.3* 

CFLOW 

unstr 

nc 

SA 

Cl only 

Y 

008 

CRUNCH CFD 

unstr 

D (mixed) 

SST 

Cl, C2a, C2b 

N 

009.1+ 

OVERFLOW 

str 

E 

SA 

Cl, C2a, C2b 

Y 

009.2* 

OVERFLOW 

str 

E 

SST 

C2a only 

n/a 

009.3* 

OVERFLOW 

str 

E 

SST-GRET 

C2c(trans) only 

n/a 

010.1+ 

CFD++ 

unstr 

A + C (mixed) 

SA 

Cl, C2a, C2b 

Y 

010.2+ 

CFD++ 

unstr 

A 

SST 

Cl only 

Y 

010.3+ 

CFD++ 

unstr 

A 

K-e-Rt 

Cl, C4 

Y 

011.1+ 

NSMB 

str 

A 

SA 

Cl, C4 

Y 

011.2+ 

NSMB 

str 

A 

SA-Edwards 

Cl, C4 

Y 

011.3* 

NSMB 

str 

A 

SA-salsa 

Cl, C4 

Y 

012.1 

PowerFLOW 

LB 

nc 

LBM-VLES 

C3a, C3b 

n/a 

012.2* 

PowerFLOW 

LB 

nc 

LBM-VLES+trans 

C3a(trans) only 

n/a 

013.1+ 

UPACS 

str 

A 

SA-noft2-R 

Cl, C4 

Y 

013.2* 

UPACS 

str 

A 

SA-noft2-R-QCR 

Cl only 

Y 

013.3* 

UPACS 

str 

A 

SST-V 

Cl only 

Y 

013.4* 

UPACS 

str 

A 

SST-V-QCR 

Cl only 

Y 

013.5* 

TAS 

unstr 

D(mixed) 

SA-noft2-R 

Cl only 

Y 

013.6* 

TAS 

unstr 

D(mixed) 

SA-noft2-R-QCR 

Cl only 

N 

014 

UNICORN 

unstr 

nc 

SGS 

Adapt, C2b only 

n/a 

015.1+ 

CFX 

unstr 

B 

SST 

Cl, C2a(no brk), C2b(no brk) 

N 

015.2+ 

Fluent 

unstr 

B 

SST 

Cl, C2a(no brk), C2b(no brk) 

N 

016.1+ 

elsA 

str 

E 

SA 

Cl only 

N 

016.2* 

elsA 

str 

A 

SA 

Cl only 

Y 

017+ 

COBRA 

str 

nc 

SA 

Cl, C2a, C2b 

N 

018 

VULCAN 

str 

A 

Wilcox 1988 

Cl, C4 with SST 

N 


* = new submission added after workshop 

+ = modified after workshop 

nc = non-committee grid 

ITER = iterative convergence history for Cl 


6 of 37 


Table 3. Summary of entries (continued) 


Entry 

Number 

Code 

Name 

Type 

Grid 

System 

Turb 

Model 

Cases run 

ITER 

provided? 

020 

OVERFFOW 

str 

E 

SA-noft2-RC 

Cl, C2a, C2b 

Y 

021+ 

TAU 

unstr 

B 

SA 

Cl, C2a, C2b, C3a, C3b 

N 

022+ 

PHASTA 

unstr 

nc 

SA 

Cl, C2a, C2b 

Y 

023 

NSU3D 

unstr 

D(mixed) 

SA 

Cl, C2a, C2b 

Y 

024.1 

EDGE 

unstr 

B 

EARSM 

Cl, C2a, C2b 

Y 

024.2+ 

EDGE 

unstr 

B 

SA 

Cl, C2a, C2b 

Y 

025 

NSU3D 

unstr 

nc 

Wilcox 198 8 

Cl, C2a, C2b 

N 

026 

MFFOW 

str 

A 

SA 

Cl, C2a, C2b, C3a, C3b 

N 

028 

Fluent 

unstr 

A + B 

SA-RC 

Cl only 

N 

029+ 

XFlow 

FB 

nc 

WMFES 

Cl, C2a, C2b, C3b 

N 


+ = modified after workshop 

nc = non-committee grid 

ITER = iterative convergence history for Cl 


B. Force and Moment Predictions 

1. Case 1: Simplified Configuration (No Brackets ) 

Figure 4 shows forces and pitching moments for Case 1 (CFD with no brackets) on the medium and fine grids. The 
lines are color-coded according to the type of method (black for unstructured, red for block-structured, green for 
overset, pink for lattice-Boltzmann). Experimental data are included for reference. Note that many participants did 
not complete all required cases, so there are some gaps and/or missing angles of attack in the plots. Some participants 
also included variation/uncertainty information when their result did not settle down to a constant value. This is shown 
as error bars in the plots. 

Some of the outliers (results that stand out from the collective) are highlighted (011.1, 011.3, and 015.1). Ignoring 
these outliers, whose predicted lift tended to be lower than the collective, most participants predicted lift levels in good 
agreement with experiment up through about a = 16° and over-predicted lift at higher angles of attack. In fact, many 
participants did not predict stall even as high as a = 22.4°. However, this is very likely a consequence of the fact that 
the brackets were not included in the computations for Case 1. Note that participants predicting lower lift tended to 
report higher uncertainty levels. In general, drag tended to be over-predicted for a given Cl and pitching moment was 
typically predicted to be too negative (pitch down). 

Grid convergence plots for the simplified configuration are shown in Figs. 5 and 6, for angles of attack of a = 7°, 
16°, 18.5°, and 20°. Fewer participants performed grid studies at the higher angles of attack. In these plots, the level 
of Cl, Cd , or Cm is plotted as a function of A/ -2 / 3 , which in 3-D is proportional to h 2 . Finer grid results are on the 
left of the plots and coarser grid results are on the right. An infinitely fine grid would be plotted as TV -2 / 3 = 0. The 
corresponding experimental value is shown as a circle symbol on the y-axis of each plot for reference. If all codes 
and implementations were completely consistent and if all turbulence models were the same, then the band of results 
should tighten, approaching a single result as A/ -2 / 3 — > 0. This did not occur here. Overall, the scatter range remained 
more or less the same across the different grid levels. One trend was evident at the higher angles of attack (Fig. 6): 
the block-structured and overset results tended to be fairly tightly clustered, whereas the unstructured results showed 
a larger variation (scatter). Although not shown, results at a = 21° were similar to those in Fig. 6, whereas results at 
a = 22.4° showed large scatter for all CFD results. 

2. Cases 2 and 3: Configuration with Additional Components 

Including the slat and flap support brackets in the CFD computations had some influence on the forces and pitching 
moment, as shown in Fig. 7 for medium grids (compare Figs. 7(b), (d), and (f) with Figs. 4(a), (c), and (e)). For 
example, including the brackets had the general tendency at Re c = 15.1 million to slightly decrease Cl over the 
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entire lift curve. Figure 7 also highlights the effects of Reynolds number. Ignoring a few outlier computations, at both 
Reynolds numbers much of the linear portion of the polar Cl was under-predicted, Cd was over-predicted, and the 
magnitude of Cm was over-predicted. Collectively, the CFD showed a greater spread near maximum lift, with some 
under-predicting and some over-predicting Cl, max and the angle at which it occurred. In Fig. 8, the idealized profile 
drag coefficient Cd p is shown. Displaying Cd p instead of Cd helps to expand the scale of the plot and see the drag 
variation better. 

Only a few participants investigated the effects of including transition. Lift, idealized profile drag, and pitching 
moment coefficients are shown in Fig. 9. (Note that 003 and 009 used Config 4 whereas 012 used Config 5.) The 
results were mixed. Recall that the 009.2 results were outliers for non-transitional results, so it is not clear whether 
the trends displayed here are representative. For 003, including transition had little influence on the lift and idealized 
drag below Cl, max, and tended to only slightly lower the pitching moment magnitude in general. However, for 012 
transition had more significant effects. In particular, lift was increased over the entire lift curve. This trend of transition 
causing higher lift is consistent with conclusions from NASA Trapezoidal Wing investigations. 7,18,20,22,28 

There were only three participants who included computations for Case 3 (the configuration with pressure tube 
bundles alongside the slat brackets): 012, 021, and 026. Results for Cl are shown in Fig. 10. Participant 012 only 
computed Case 3, so the influence of the pressure tube bundles cannot be isolated. However, both 021 and 026 
computed on both Config 4 (Case 2) and Config 5 (Case 3). In Figs. 10(b) and (c) one can see that the pressure 
tube bundles had little influence except near stall, where they caused loss of lift. This trend was consistent with an 
experimental investigation. 33 Although it is not clear which configuration yielded better agreement with experiment, 
certainly the potential influence of the pressure tube bundles on stall behavior for this model cannot be ignored. 

C. Iterative Convergence 

One of the conclusions from HiLiftPW- 1 was that iterative convergence information should be collected from future 
workshop participants. This collection was done for HiLiftPW-2 for Case 1, although not all participants provided 
the requested information (see Tables 2 and 3). All who did comply provided force and moment histories; many 
also included various residual convergence histories. Some representative results are plotted in Figs. 11 and 12 for 
a = 7°. In Fig. 11, results are shown from those entries for which the final Cl still appeared to be changing by the 
last reported iteration. Iterations are normalized so that 0 represents the first iteration reported and 1 represents the 
last. Entry 004.1, 005.1, and 005.2 each showed a changing Cl with negative slope at the last iteration, while 011.1, 
011.3, and 022 each showed significant oscillatory behavior (note that 022 was run time-accurately). As shown in 
Fig. 11(b), the 004.1, 005.1, and 005.2 entries indicated converging density equation residuals (all residuals have been 
normalized so that they start at 1). Both 011.1 and 01 1.3 displayed “stalled” residual behavior, and 022 did not supply 
residual information. 

Figure 12 shows representative results from several entries for which the final Cl appeared to be better converged 
(relatively flat or unchanging). Interestingly, most of the residuals for these apparently better-converged results either 
“stalled” or leveled off. Three of the representative results drove the residuals down about 5 or 6 orders of magnitude 
prior to leveling off, while two exhibited weaker convergence over the iteration range reported. Although not shown, 
representative iterative results for other angles of attack were similar to those shown here. These results indicate that 
the HiLiftPW-2 high lift cases were generally not easy to converge for many CFD solvers. They also offer a caution 
when analyzing the workshop data: insufficient iterative convergence may account for some of the differences between 
different CFD codes. 

D. Velocity Profiles 

Velocity data were collected for Cases 1, 2, and 3, although not all participants provided the requested information. 
In this section, we divide a sampling of the results into two parts. First, results are shown for Case 1 (CFD only - 
no brackets), for which CFD results at a = 7° are compared to each other for consistency. (Because Case 1 did not 
involve brackets, experimental data are not included.) Second, results are shown for Cases 2a and 3a, for which CFD 
results at a = 7° and 18.5° are compared to low Reynolds number experiment. 

Figures 13 and 14 show CFD Case 1 results at a = 7° at all eleven stations. As depicted in Fig. 13(a), the stations 
were labeled in the experiment according to their span wise row location (1 for y = 246.386 mm, 2 for y = 979.596 
mm, and 3 for y = 1223.999 mm), then by area (B for near the slat trailing edge, C for forward part of the main wing, 
D for aft part of the main wing, and E for the flap). The final number designation stands for the line number extracted 
within the area. In the figures, several outliers have been highlighted in blue. In some cases these results may have 
been different due to errors made by the participants when extracting the velocity profiles. Ignoring the outliers, the 
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results in red show reasonably consistent velocity profiles at many of the locations, but this consistency deteriorated at 
the outboard two stations on the rear part of the main wing and on the flap. The results at location 3E2 showed a very 
large variation. 

Inspecting the plots in Figs. 13 and 14, one can see that some of the results showed distinct, relatively deep wake 
profiles and some did not. This difference was primarily a function of the grid employed. As an example, Fig. 15 shows 
results at location 3E1, divided among different grids. Structured results on medium grids A and E are highlighted in 
bold blue in Fig. 15(a), unstructured results on medium grids A and C are highlighted in bold red in Fig. 15(b), and 
unstructured results on medium grids B and D are highlighted in bold red in Fig. 15(c). The B and D grids yielded 
significantly smeared (under-resolved) wake profiles from the upstream elements compared to the other grids. Even 
use of the fine B and D grids (shown in Fig. 15(d)) did not improve this aspect of the results at all. Although not 
shown, results at other locations showed similar trends. 

Figure 16 shows low Reynolds number results at three selected stations and two angles of attack. The CFD results 
include both Case 2a (brackets included) and Case 3a (brackets and pressure tube bundles included). Aside from a few 
outliers, the CFD results were reasonably consistent with each other at a = 7°, but less so at a = 18.5°. CFD results 
tended to be shifted from experiment, predicting velocities too low. Only two participants computed Case 3a; there 
were no notable consistent trends exhibited at these locations by adding the pressure tube bundles. 

E. Surface Pressure and Skin Friction Coefficients 

A significant amount of surface pressure and skin friction data was collected from the participants, along ten different 
span wise stations for all cases, as well as at many different angles of attack. Due to the large volume of data collected, 
much of it has not yet been analyzed. Here, a few results are highlighted. 

Figure 17 shows a few typical C p results at a = 7° at three selected locations. (The particular entries shown 
here — 024.1, 020, and 002.1 — were randomly selected to be representative. There were variations among the different 
CFD entries as would be expected, with larger variations occurring on the flap as well as at outboard stations.) On the 
flap at the inboard-most station 2 y/B = 0.15 in Fig. 17(a), high Reynolds number results with no brackets tended to 
predict too much suction on the upper surface compared to experiment as the grid was refined. When including the 
brackets (Fig. 17(b)), the opposite occurred and CFD predicted too little upper surface suction at this location. The 
trend with Reynolds number was not captured. On the slat at the station 2 y/B = 0.89 in Fig. 17(c), little influence of 
grid was exhibited for high Reynolds number results with no brackets included, and the pressures on the suction side 
were somewhat low. Including brackets (Fig. 17(d)) helped the CFD to capture the upper surface C p levels; there was 
also excellent agreement with Reynolds number trends. In Fig. 17(e), results are shown for the flap at the outboard- 
most span station 2 y/B = 0.96 at high Reynolds number with no brackets. CFD missed the pressures on the lower 
surface. Including brackets (Fig. 17(f)) helped the CFD to capture the lower surface levels accurately. The Reynolds 
number trend was qualitatively captured, but the upper surface pressure levels did not match experiment. 

Figure 18 shows Case 2a and 2b C p results at two span stations at a = 20° near Cl, max- Here, results from 
all participants who submitted these cases are included with the exceptions of 007.1 (because results were very poor 
and probably extracted incorrectly) and 015.1/015.2 (because they did not include brackets). Fow Reynolds number 
CFD results are represented by solid red lines or (for data that were not ordered) by tiny red symbols. High Reynolds 
number CFD results are represented by blue lines or tiny blue symbols. The experimental data are represented by large 
symbols. Near mid-span at 2 y/B = 0.54, CFD results on the slat and main elements were very consistent, and agreed 
well with experiment (both levels and Reynolds number trends). On the flap, however, a larger degree of variation 
was exhibited among the CFD solutions. Qualitatively, a trend with Reynolds number was seen, but the experimental 
levels were not captured. At the span station 2 y/B = 0.89, CFD results exhibited significant variation on all three 
elements. Some trends with Reynolds number were seen, but pressure levels were particularly missed on the flap at 
low Reynolds number. 

Surface skin friction coefficients were optional for the participants of the workshop, so less data were provided. 
Also, no experimental skin friction data were available for comparison. Figure 19 shows Case 2a and 2b Cf jX CFD 
results at two different angles of attack on the flap at span stations 2 y/B = 0.15, 0.54, and 0.89. (Note that 009.1 
results were left out due to obvious errors in Cf extraction.) Results at a = 7° are in the left column, and results at 
a = 16° are on the right. Again, red lines and symbols represent low Reynolds number, and blue lines and symbols 
represent high Reynolds number. The CFD results were generally very close to each other on the lower surface, but 
exhibited more variation on the upper surface. At both angles of attack, some of the CFD results showed a small 
amount of trailing edge separation at 2 y/B = 0.54. At 2 y/B = 0.89, more separation was evident, particularly at the 
low Reynolds number condition. 
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F. Statistical Analysis 

In the statistical analysis of this section, the basic method used by Morrison 49 was employed. For any quantity of 
interest ( Cl for example), the scatter limits were established as jl d= K a, where (i is the median of the sorted data, 
<r is the standard deviation, and K is a confidence interval coverage factor, taken to be K = \/3- The coefficient of 
variation, defined as C v = a/ jl, provides a measure to compare the variation of populations with different medians. 
This same statistical methodology was also used in the analysis of HiLiftPW-1. 5 A statistical outlier (a point residing 
outside of the scatter limits) is by definition different from the results that lie within the scatter limits. In terms of CFD 
solutions, being an outlier means that some aspect of the CFD solution was significantly different from the collective, 
and its cause(s) should be investigated. In the plots to follow, any sample lying well outside of the limits is noted in 
the figure. However, because the scatter limits depend on the choice of K , the fact that a particular point lies outside 
may or may not be significant. 

Figure 20 shows results from the statistical analysis of Case 1 (no brackets, high Re) at a = 7°. The top row is 
Cl, middle row is Cd, and bottom row is Cm • The left column shows coarse grid results, middle column is medium 
grid results, and right column is fine grid results. In all cases, (as is desirable) the scatter range and C v both decreased 
as grid was refined. However, the biggest difference occurred between coarse and medium grids, and very little change 
occurred between the medium and fine grids. The few outliers produced lift values that were too low compared to the 
collective. Median lift increased with grid refinement while pitching moment decreased. Drag changed very little. 

Figure 21 shows results from the statistical analysis of Case 1 at a = 16°. In this case, scatter range and C v again 
decreased for Cl with grid refinement, but for drag they remained fixed on the medium and fine grids and for pitching 
moment the scatter range increased slightly on the fine grid. The outliers again produced lift values that were too low 
compared to the collective. Median lift increased with grid refinement while pitching moment decreased and drag 
increased only slightly. 

Figure 22 summarizes the coefficients of variation for Case 1 at a = 7° and 16° and compares them with the C v 
values from HiLiftPW-1. C v levels for lift and drag were somewhat similar between the two workshops, although 
the current HiLiftPW-2 results decreased less (flattened more) between the medium and fine grids (i.e., the fine grid 
C v levels for HiLiftPW-2 tended to be higher than the fine grid C v levels for HiLiftPW-1). \C V \ levels for pitching 
moment were higher than for HiLiftPW-1, and also flattened more than for HiLiftPW-1 between the medium and fine 
grids. In other words, for HiLiftPW-2, going from medium to fine grids overall did not tend to bring the various CFD 
results much closer together, as would generally be expected. The reason for this is not known. 

In Fig. 23, an attempt was made to seek trends for Case 1 by turbulence model, by grid type, and by grid. Specific 
trends should manifest themselves by showing a particular bias compared to the median. However, few significant 
trends stood out among the results with a sufficiently large population; most symbols appeared to be fairly randomly 
distributed. One possible trend was that structured-overset results (corresponding to grid E) for a = 16° tended to 
give higher than average lift. Another noteworthy point is that at both angles of attack the two SA results giving the 
lowest lift were 007.2 and 011.1. Recalling the verification exercise from Fig. 3(b), these particular implementations 
of SA were suspect. 

Figures 24 through 28 display statistical analyses of forces and pitching moments for Cases 2a and b (which 
included brackets) at a = 0°, 7°, 16°, 20°, and 21°, respectively. Experimental values (yellow circles) are also 
displayed in the figures for comparison. For both Reynolds numbers at a = 0° and 7°, the median values of lift, 
drag, and pitching moment were somewhat different compared to experiment, but the CFD scatter bands contained 
the experiment. At a = 16°, the median CFD value of Cl agreed almost perfectly with experiment at both Reynolds 
numbers, but drag was significantly over-predicted and pitching moment was significantly under-predicted. At a = 
20°, the median CFD value of Cl was again excellent compared with experiment at both Reynolds numbers. Drag 
was predicted well at the low Reynolds number condition, but again over-predicted at high Reynolds number. Moment 
was significantly under-predicted at both Reynolds numbers. At a = 21°, the median CFD value of Cl was only 
slightly high compared to experiment (the CFD scatter band contained the experiment). Drag was under-predicted 
at the low Reynolds number condition and over-predicted at high Reynolds number. Moment was again significantly 
under-predicted. 

Referring back to Fig. 7, recall that the entries exhibited more spread near stall (with some entries over-predicting 
Cl, max and some under-predicting it). Interestingly, the median value from the CFD codes happened to come out 
relatively accurately in predicting the lift at the highest angles of attack. However, this may have been luck. At 
high Reynolds number the median Cl of the CFD was still increasing at a = 21°, whereas in the experiment it 
was starting to decrease. Furthermore, the large spread of CFD behavior near Cl, max makes it doubtful that the 
CFD codes collectively and consistently captured the physical mechanism(s) responsible for stall. The reasons for the 
mis-predictions in drag and pitching moment over much of the polars above a = 7° is not known. 
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To further explore how well the median values from the CFD codes captured Reynolds number trends, delta values 
of Cl, Cd, and Cm are plotted in Fig. 29. For example, A Cl = CL,hiRe ~ CljoRb- Overall, the shapes of the 
delta curves as a function of angle of attack were qualitatively captured, but A Cl at low a was over-predicted, and 
the magnitude of the negative A Cd at high a was under-predicted. 

VII. Conclusions 

The entries from the second AIAA High-Lift Prediction Workshop (HiLiftPW-2) have been summarized, both by 
looking at collective results compared with experiment and through statistical analyses. A large number of surface 
pressures, skin frictions, and velocity profiles were collected, but only a small portion of these have been analyzed to 
date, and only a few representative plots have been shown here. 

An optional turbulence model verification case was included in this workshop, and computed by a few of the 
participants. For those who used the SA model, there was near-perfect consistency among three entries, one other 
entry was very close, and two exhibited notable differences. These two differences suggest potential problems or 
inconsistencies in implementation, which should be investigated by the owners of the codes in question. 

For the DLR-F1 1 case in general, the importance of including slat and flap brackets when comparing with experi- 
ment was established. From previous experimental oil flow, it appeared that two slat tracks were influential in causing 
large wedge-shaped regions of separated flow on the main element near stall. Without brackets, the CFD could not 
possibly capture this type of stall mechanism, and indeed most entries without brackets tended to predict increasing 
Cl well past the nominal stall angle. There was also some evidence from the few participants who ran Case 3 that 
pressure tube bundles included alongside the slat tracks on the wind tunnel model had an influence on the flow field 
near C L , max- 

In terms of consistency, the CFD exhibited spreads in results that tended to remain about the same when going 
from the medium to the fine grid levels. In other words, the CFD scatter did not decrease much past a certain grid 
refinement level; the reasons for this are not known. Scatter was larger at the angles of attack near stall, as expected. A 
small part of the CFD inconsistencies may have been due to poor or insufficient iterative convergence, as participants 
had some difficulty fully converging many of the cases. Looking at details such as pressure coefficients and velocity 
profiles, the inconsistencies between CFD results tended to be larger on the flap as well as at the outboard stations of 
the wing. Some of the unstructured grids were shown to be poor for capturing the wakes of upstream elements. 

Most of the participants used the Spalart-Allmaras turbulence model or variant. Nonetheless, the variation among 
entries using this model appeared to be as great as differences due to the use of other turbulence models. In other 
words, no clear trends with turbulence modeling were exhibited in the results. A few participants investigated the use 
of transition, but unlike results for the NASA Trapezoidal Wing of the first high lift workshop, results were mixed and 
no clear trends stood out. 

When including the slat and flap brackets, the median CFD results tended to be slightly low predicting lift at 
a = 7°, accurate at a = 16° and 20°, then somewhat high at a = 21°. However, the scatter range for CFD’s Cl 
results (approximately 0.2 at low angles of attack and typically higher in the range of 0.3 — 0.6 at high angles of attack) 
always included the experimental values. This was generally not the case for drag and pitching moment, both of which 
were consistently mis-predicted at angles of attack above a = 7° . Reynolds number trends were only qualitatively 
captured by the CFD. 

HiLiftPW-2 continued in the tradition of the first workshop in the series, by again bringing together many re- 
searchers from around the world with a variety of CFD codes to analyze a specific high lift configuration. This new 
configuration offered different challenges from the configuration of the first workshop. The CFD results again lacked 
consistency to the levels desired, but much was learned by quantifying the differences and by taking steps to attempt to 
isolate possible causes. For example, including verification testing as well as iterative convergence information were 
both very useful aspects that could serve as prerequisites for future workshops. Workshops like this are very valuable 
for the aeronautical engineering community, and should continue to be pursued. 
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Figure 1. Photograph of DLR-F11 high lift model in the B-LWST wind tunnel. 



Figure 2. Case 1 supplied grid sizes. 



Figure 3. 2-D bump verification case using SA model and variants. 
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Figure 4. Case 1 (no brackets, high Re) forces and pitching moments (experiment shown for reference). 
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Figure 5. Case 1 (no brackets, high Re) grid convergence behavior at a = 7° and 16° (experiment shown for reference). 
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Figure 6. Case 1 (no brackets, high Re) grid convergence behavior at a = 18.5° and 20° (experiment shown for reference). 
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Figure 7. Case 2 (medium grids with with brackets) forces and pitching moments. 
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Figure 8. Cd p curves for Case 2 (medium grids with brackets). 




(a) Cl (b) Cd p 



(c) Cm 


Figure 9. Effects of including transition on forces and pitching moments, Re c = 1 35 x 10 6 (medium grids with brackets). 
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Figure 10. Effect of including pressure tube bundles on Cl (medium grids with brackets). 
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(b) Normalized density equation residual 


Figure 11. Case 1 (no brackets, high Re) a = 7° iterative convergence information for entries with Cl still changing at final iteration. 
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Figure 12. Case 1 (no brackets, high Re) a = 7° representative iterative convergence information for entries with Cl relatively flat at 
final iteration (all entries not shown). 
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Figure 13. Case 1 (no brackets, high Re) a = 7° velocity profiles from CFD results on medium grids (part 1); obvious outliers denoted by 
blue lines. 
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Figure 14. Case 1 (no brackets, high Re) a = 7° velocity profiles from CFD results on medium grids (part 2); obvious outliers denoted by 
blue lines. 
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Figure 15. Case 1 (no brackets, high Re) a = 7° velocity profiles at location 3E1, highlighted by grid type (outliers removed). 
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Figure 16. Case 2a (with brackets, low Re) and 3a (with brackets and bundles, low Re) velocity profiles at selected locations using medium 
grids. 
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Figure 17. Sampling of typical surface pressure coefficients at a = 7° . 


26 of 37 




(c) Main at 2 y/B = 0.54 


(d) Main at 2 y/B = 0.89 



(e) Flap at 2 y/B = 0.54 


(f) Flap at 2 y/B = 0.89 


Figure 18. Pressure coefficients at two span stations for a = 20° (with brackets included). 
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Figure 19. The ^-component of skin friction coefficients on the flap at a = 7° and 16° (with brackets included). 
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Figure 20. Statistical analysis of Case 1 (no brackets, high Re), a = 7° ; solid blue line is median of data, dashed blue lines are scatter 
limits. 
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Figure 21. Statistical analysis of Case 1 (no brackets, high Re ), a = 16°; solid blue line is median of data, dashed blue lines are scatter 
limits. 
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Figure 22. Summary of coefficients of variation, in comparison with HiLiftPW-1 results. 
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Figure 23. Statistical analysis of Case 1 (no brackets, high Re) Cl on medium grids, separated by types. 
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Figure 24. Statistical analysis of Cases 2a and b (includes brackets), a = 0° on medium grids (yellow circle at right represents experiment). 


32 of 37 


o 



entry number 

(a) C L at Re c = 1.35 x 10 6 


O 



entry number 

(b) C L at Re c = 15.1 x 10 6 



(c) C D at Re c = 1.35 x 10 6 


0.19 


0.18 


0.17 


a 

O 


0.16 


0.15 


0.14 


005.2 


008 


■ _ £ 


median = 0.1660 
scatter range = 0.010 
Cv = 0.018 


entry number 

(d) C D at Re c = 15.1 x 10 6 


- 0.2 


-0.3 


-0.4 


s 

O 


-0.5 


- 0.6 - 


-0.7 


007.2 

007,1 ^ b 009,2 


median = -0.5166 
scatter range = 0.113 
|Cv| = 0.063 


- 0.2 


-0.3 


-0.4 


s 

O 


-0.5 - 


- 0.6 = 


-0.7 


007.1 007.2 


-h.h, 


median = -0.5607 
scatter range = 0.090 
|Cv| = 0.046 


entry number entry number 

(e) C M at Re c = 1.35 x 10 6 (f) C M at Re c = 15.1 x 10 6 

Figure 25. Statistical analysis of Cases 2a and b (includes brackets), a = 7° on medium grids (yellow circle at right represents experiment). 
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Figure 26. Statistical analysis of Cases 2a and b (includes brackets), a = 16° on medium grids (yellow circle at right represents experi- 
ment). 
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Figure 27. Statistical analysis of Cases 2a and b (includes brackets), a = 20° on medium grids (yellow circle at right represents experi- 
ment). 
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Figure 28. Statistical analysis of Cases 2a and b (includes brackets), a = 21° on medium grids (yellow circle at right represents experi- 
ment). 


36 of 37 





Figure 29. Deltas due to Reynolds number for Cases 2a and b (includes brackets), comparing median CFD results with experiment. 
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